Automatic Grammatical Error Detection of Non-native Spoken Learner English

Automatic language assessment and learning systems are required to support the global growth in English language learning. They need to be able to provide reliable and meaningful feedback to help learners develop their skills. This paper considers the question of detecting grammatical errors in non-native spoken English as a first step to providing feedback on a learner's use of the language. A state-of-the-art deep learning based grammatical error detection (GED) system designed for written texts is investigated on free speaking tasks across the full range of proficiency grades with a mix of first languages (L1s). This presents a number of challenges. Free speech contains disfluencies that disrupt the spoken language flow but are not grammatical errors. The lower the level of the learner the more these both will occur which makes the underlying task of automatic transcription harder. The baseline written GED system is seen to perform less well on manually transcribed spoken language. When the GED model is fine-tuned to free speech data from the target domain the spoken system is able to match the written performance. Given the current state-of-the-art in ASR, however, and the ability to detect disfluencies grammatical error feedback from automated transcriptions remains a challenge.This paper reports on research supported by Cambridge Assessment, University of Cambridge. Thanks to Cambridge English Language Assessment for supporting this research and providing access to the BULATS dat

Impact of ASR performance on free speaking language assessment

In free speaking tests candidates respond in spontaneous speech to prompts. This form of test allows the spoken language proficiency of a non-native speaker of English to be assessed more fully than read aloud tests. As the candidate's responses are unscripted, transcription by automatic speech recognition (ASR) is essential for automated assessment. ASR will never be 100% accurate so any assessment system must seek to minimise and mitigate ASR errors. This paper considers the impact of ASR errors on the performance of free speaking test auto-marking systems. Firstly rich linguistically related features, based on part-of-speech tags from statistical parse trees, are investigated for assessment. Then, the impact of ASR errors on how well the system can detect whether a learner's answer is relevant to the question asked is evaluated. Finally, the impact that these errors may have on the ability of the system to provide detailed feedback to the learner is analysed. In particular, pronunciation and grammatical errors are considered as these are important in helping a learner to make progress. As feedback resulting from an ASR error would be highly confusing, an approach to mitigate this problem using confidence scores is also analysed

Rapidity and Centrality Dependence of Proton and Anti-proton Production from Au+Au Collisions at sqrt(sNN) = 130GeV

We report on the rapidity and centrality dependence of proton and anti-proton transverse mass distributions from Au+Au collisions at sqrt(sNN) = 130GeV as measured by the STAR experiment at RHIC. Our results are from the rapidity and transverse momentum range of |y|<0.5 and 0.35 <p_t<1.00GeV/c. For both protons and anti-protons, transverse mass distributions become more convex from peripheral to central collisions demonstrating characteristics of collective expansion. The measured rapidity distributions and the mean transverse momenta versus rapidity are flat within |y|<0.5. Comparisons of our data with results from model calculations indicate that in order to obtain a consistent picture of the proton(anti-proton) yields and transverse mass distributions the possibility of pre-hadronic collective expansion may have to be taken into account.Comment: 4 pages, 3 figures, 1 table, submitted to PR

Alignment of the ALICE Inner Tracking System with cosmic-ray tracks

37 pages, 15 figures, revised version, accepted by JINSTALICE (A Large Ion Collider Experiment) is the LHC (Large Hadron Collider) experiment devoted to investigating the strongly interacting matter created in nucleus-nucleus collisions at the LHC energies. The ALICE ITS, Inner Tracking System, consists of six cylindrical layers of silicon detectors with three different technologies; in the outward direction: two layers of pixel detectors, two layers each of drift, and strip detectors. The number of parameters to be determined in the spatial alignment of the 2198 sensor modules of the ITS is about 13,000. The target alignment precision is well below 10 micron in some cases (pixels). The sources of alignment information include survey measurements, and the reconstructed tracks from cosmic rays and from proton-proton collisions. The main track-based alignment method uses the Millepede global approach. An iterative local method was developed and used as well. We present the results obtained for the ITS alignment using about 10^5 charged tracks from cosmic rays that have been collected during summer 2008, with the ALICE solenoidal magnet switched off.Peer reviewe

First measurement of the |t|-dependence of coherent J/ψ photonuclear production

The first measurement of the cross section for coherent J/ψ photoproduction as a function of |t|, the square of the momentum transferred between the incoming and outgoing target nucleus, is presented. The data were measured with the ALICE detector in ultra-peripheral Pb–Pb collisions at a centre-of-mass energy per nucleon pair sNN=5.02TeV with the J/ψ produced in the central rapidity region |y|<0.8, which corresponds to the small Bjorken-x range (0.3−1.4)×10−3. The measured |t|-dependence is not described by computations based only on the Pb nuclear form factor, while the photonuclear cross section is better reproduced by models including shadowing according to the leading-twist approximation, or gluon-saturation effects from the impact-parameter dependent Balitsky–Kovchegov equation. These new results are therefore a valid tool to constrain the relevant model parameters and to investigate the transverse gluonic structure at very low Bjorken-x.publishedVersio

Resolving the strange behavior of extraterrestrial potassium in the upper atmosphere

It has been known since the 1960s that the layers of Na and K atoms, which occur between 80 and 105 km in the Earth's atmosphere as a result of meteoric ablation, exhibit completely different seasonal behavior. In the extratropics Na varies annually, with a pronounced wintertime maximum and summertime minimum. However, K varies semiannually with a small summertime maximum and minima at the equinoxes. This contrasting behavior has never been satisfactorily explained. Here we use a combination of electronic structure and chemical kinetic rate theory to determine two key differences in the chemistries of K and Na. First, the neutralization of K+ ions is only favored at low temperatures during summer. Second, cycling between K and its major neutral reservoir KHCO3 is essentially temperature independent. A whole atmosphere model incorporating this new chemistry, together with a meteor input function, now correctly predicts the seasonal behavior of the K layer

Automatic grammatical error detection of non-native spoken learner English

Automatic language assessment and learning systems are required to support the global growth in English language learning. They need to be able to provide reliable and meaningful feedback to help learn- ers develop their skills. This paper considers the question of detect- ing “grammatical” errors in non-native spoken English as a first step to providing feedback on a learner’s use of the language. A state- of-the-art deep learning based grammatical error detection (GED) system designed for written texts is investigated on free speaking tasks across the full range of proficiency grades with a mix of first languages (L1s). This presents a number of challenges. Free speech contains disfluencies that disrupt the spoken language flow but are not grammatical errors. The lower the level of the learner the more these both will occur which makes the underlying task of automatic transcription harder. The baseline written GED system is seen to perform less well on manually transcribed spoken language. When the GED model is fine-tuned to free speech data from the target do- main the spoken system is able to match the written performance. Given the current state-of-the-art in ASR, however, and the ability to detect disfluencies grammatical error feedback from automated transcriptions remains a challenge

Impact of ASR performance on free speaking language assessment

In free speaking tests candidates respond in spontaneous speech to prompts. This form of test allows the spoken language proficiency of a non-native speaker of English to be assessed more fully than read aloud tests. As the candidate's responses are unscripted, transcription by automatic speech recognition (ASR) is essential for automated assessment. ASR will never be 100% accurate so any assessment system must seek to minimise and mitigate ASR errors. This paper considers the impact of ASR errors on the performance of free speaking test auto-marking systems. Firstly rich linguistically related features, based on part-of-speech tags from statistical parse trees, are investigated for assessment. Then, the impact of ASR errors on how well the system can detect whether a learner's answer is relevant to the question asked is evaluated. Finally, the impact that these errors may have on the ability of the system to provide detailed feedback to the learner is analysed. In particular, pronunciation and grammatical errors are considered as these are important in helping a learner to make progress. As feedback resulting from an ASR error would be highly confusing, an approach to mitigate this problem using confidence scores is also analysed